Electrically controllable surface magnetism on the surface of topological insulator 
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We study theoretically the RKKY interaction between magnetic impurities on the surface of three- 
dimensional topological insulators, mediated by the helical Dirac electrons. Exact analytical expression shows 
that the RKKY interaction consists of the Heisenberg-like, Ising-like and DM-like terms. It provides us a new 
way to control surface magnetism electrically. The gap opened by doped magnetic ions can lead to a short-range 
Bloembergen-Rowland interaction. The competition among the Heisenberg, Ising and DM terms leads to rich 
spin configurations and anomalous Hall effect on different lattices. 
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Introduction. — All-electrical quantum manipulation of the 
spin degree of freedom of electrons and/or magnetic ions is 
a central issue in the fields of spintronics and quantum infor- 
mation processing. Spin-orbit interactions in solids is a inher- 
ent relativistic effect and can be tuned by an external electric 
field, i.e., breaking of spatial inversion symmetry. Recent dis- 
covery demonstrate that the spin-orbit interactions can invert 
the conduction and valence bands, and leads to a new state of 
matter named topological insulator (TI) in a number of ma- 
terials, such as a two-dimensional (2D) HgTe quantum well 
[1-3], and three-dimensional (3D) Bi^Sb^^. [4, 5], Bi 2 Se 3 
and Bi2Te3 [6-8]. These TIs possess an insulating bulk and 
metallic edge or surface states that are protected by the time 
reversal symmetry (TRS). The energy spectrum of the sur- 
face states shows a single massless Dirac cone at F point of 
the Brillouin zone, which was experimentally verified using 
the angle-resolved photoemission spectroscopy (ARPES) ex- 
periments [5, 8, 9]. Electrical tuning of the Fermi energy in 
3D TI materials is reported by changing the backgate voltage 
[10]. Although the energy spectrum of the surface states of 
3D TI is very similar with that of graphene, but there is an im- 
portant difference between graphene and TIs. The helicity of 
graphene is not defined in regard to the real spin of the elec- 
tron but to the two sublattices of graphene. Contrastingly, the 
helicity of the surface state of 3D TI is defined in regard to 
the electron spin. The helical surface state is spin-momentum 
locked and certainly leads to spin relevant effects, e.g., spin 
filtering and giant magnetoresistance, the Ruderman-Kittel- 
Kasuya-Yosida (RKKY) interaction [11, 12]. 

The RKKY interaction is an indirect exchange interaction 
between magnetic ions mediated by itinerant electrons. This 
long-range spin-spin interaction play a crucial role in mag- 
netic metals and diluted magnetic semiconductor. One can 
expect that the mediated helical electrons on the surface of 
a 3D TI must lead to some unusual properties of the RKKY 
interaction. Importantly, introducing of many magnetic impu- 
rities in 3D TIs breaks the TRS and open a gap in the Dirac 
spectrum of the surface states [13]. This transition makes the 
massless Dirac electrons become the massive ones and change 
the spin orientation of the surface states near the Dirac point. 
The characteristics of the itinerant electron states, e.g., chiral- 



ity and energy dispersion, determine the spin-spin interaction 
between magnetic impurities. However, the back action of 
magnetic impurities also affects the electron states, e.g., the 
gap opening, and consequently alters the spin-spin interac- 
tion. Recent experiments demonstrate that a strong warping 
effect in the energy spectrum of the surface states of the 3D 
TIs, e.g., Bi2Se3 and Bi2Te3 [8, 9, 14]. The warping effect 
becomes more significant at high Fermi energy, and certainly 
influences the surface magnetism of 3D TIs. 

In this Letter, we draw attention to the surface magnetism 
of a 3D TI, utilizing the RKKY interaction mediated by heli- 
cal massless or massive Dirac electrons. From the analytical 
expression of the RKKY interaction, we demonstrate theoret- 
ically that one can implement various quantum spin models 
by changing applied gate voltage, e.g., the Dzyaloshinskii- 
Moriya (DM) model, the XXZ model and the XZ model. 
The gap opening caused by the magnetic impurities results 
in an additional Ising term in the RKKY interaction and lead 
to a short-range correlation, i.e., the Bloembergen-Rowland 
(BR) interaction, when the Fermi energy is located in the gap. 
The warping effect behaves like an anisotropic momentum- 
dependent effective magnetic field perpendicular to the sur- 
face, leading to an crystallographic orientation-dependent 
RKKY interaction. The local spins can be arranged in vari- 
ous lattices, e.g., triangular and square lattices formed by the 
STM technique, the pinning effect, or the Coulomb interac- 
tion. The interplay between the unique property of the RKKY 
interaction and the geometry of spin lattice results in the rich 
spin configurations of the ground states of spin systems, e.g., 
the ferromagnetic, antiferromagnetic and spin frustration on 
the surface of a 3D TI. 

Hamiltonian and RKKY interaction. — First we consider 
two magnetic impurities S, (2 = 1,2) located at R, medi- 
ated by massless Dirac electrons on the surface of 3D TI 
(see Fig. 1(a)). The Hamiltonian of the system is H = 
Hq + H'"', where the massless Dirac electron Hamiltonian 
[15] Hq — Tivf (k x Oy — k y a x ) + j (lc\ + k 3 _) a z and the s-d in- 
teraction between the magnetic impurities and the electrons 
H'"' = —J ( a -S) 8 (r — R,). k is in-plane momentum of elec- 
tron, 7? = (<7r, <7y, ov) is the Pauli matrix denoting real spin of 
electron, vp is the Fermi velocity of the surface states, which 
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FIG. 1: (color online), (a) Schematic of two local spins on the sur- 
face of TI, with electrically controllable RKKY interaction. The 3D 
topological thin film is epitaxially grown on SrTiC>3 substrates [10]. 
(b) The massless and massive surface state with spin orientation. The 
2A denotes the gap caused by breaking TRS. (c) The warping effect 
of Bi2X3 class TI with spin orientation. 



is given by 6.2 x 10 5 ms _1 for Bi2Se3 [6] and 3.9 x 10 5 ms _1 
for Bi2Te3 [15]. J is a unit vector along the normal direction 
of the surface. X is the magnitude of the hexagonal warping 
term. J denotes the strength of the s-d exchange interaction, 
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which is around 2^13 eV A [11]. 

We first neglect the warping effect, the Green's 
function in real space can be obtained as G £ (±R) = 
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W v > (x) is the 



V-order Hankel function 
first kind, and R = Rur. In the loop 
imation we find the RKKY interaction 
two magnetic impurities in the form of H 
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where Ef is the Fermi energy, and Tr means a partial trace 
over the spin degree of freedom of itinerant Dirac electrons. 
Then the RKKY interaction can be written as 



ttRKKY 
#1,2 



= F l {R,e F )S 1 -S 2 +F 2 (R,£ F )(S l xS 2 ) y 
+F 3 (R,e F )S y l Sl, (1) 



where the range functions are 



Fi(R,e F ) 




F 2 (R,e F ) 



J 1 



An^tivpR 3 



2 a 2 



Re 



-■ 2 



h 2 v 2 F '2,2,0,1 



,2.0 
'1,3 



2-2 



R^E 



n 2 v y 1,2,0 



F 3 (R,£ F ) = 



J 2 



[<4i 



27Z*>hv F R 3 



R 2 e} 



1,2 



3 3 o 3 
2' 2' u ' 2 



Here G™'^ is the Meijer's G-function [16]. The RKKY in- 
teraction consists of three terms: the Heisenberg-like term, 
the DM-like term and the Ising-like term, displaying differ- 
ent range functions. The competition among these three terms 
can implement various spin models. 

All three range functions show damped oscillation as the 
distance R increases, this behavior indicates that this RKKY 
interaction is a long-range correlation between two spins (see 
Fig. 2(a)). Utilizing the asymptotic form of Hankel functions, 
the long-range asymptotic behavior of the RKKY interaction, 
i.e., e F R » 1, is 
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From Eq. (2), the oscillatory behavior of RKKY interaction 
in a n-type TI (e F > 0) can be clearly seen and dominates at 
large e F R. The long-range behaviors of the Heisenberg term 
and Ising term show a spatial dependence as 1 /R 2 , which is 
the same as in a conventional 2D electron gas, but in con- 
trast with that in graphene where the spatial dependence is 
\/R? . Interestingly, one can see that the range functions for 
the Heisenberg and Ising terms have almost the same magni- 
tude but opposite sign. It means that the Ising term always 
cancel the z-component of the Heisenberg term. By prop- 
erly adjusting the distance R using the STM technique and/or 
the Fermi energy e F (see Fig. 2(b)), one can even diminish 
the Heisenberg and Ising terms and obtain a RKKY inter- 
action containing the DM interaction alone. The RKKY in- 
teraction becomes H? 2 KY (R, e F ) ~ F 2 (R, e F ) (Si xS 2 ) v , i.e., 
a pure DM-like spin model. The long-range asymptotic 
form of the DM interaction also decreases as 1 /R 2 , but with 
±7r/2 phase shift compared to other two terms. By set- 
ting e F = 0, i.e., the intrinsic 3D TI case, the DM term 
vanishes, the RKKY interaction can be simply written as 

ttRKKY _ J 2 
"1,2 - l6nhv F R i 



2SfSf + 25f5§-S^j, a XXZ-like spin 



model. Notice that the range function monotonically decreas- 
ing as 1 /R? (see the inset in Fig. 2(a)) in this case, the same 
as that in graphene. 

The gap opening and warping effects. — Next we study the 
gap opening effect caused by magnetic impurities in the TIs. 
The surface states are described by a massive Dirac Hamilto- 
nian H^ ap " > = hv F (k x a y — k y a x ) + Aav, where 2A denotes the 
gap caused by breaking TRS (see Fig. 1(b)). This Hamilto- 
nian means that the magnetic impurities behave as a Zeeman 
term which lifts the degeneracy of Dirac point. Similarly, we 
get the RKKY interaction including the gap opening effect, 

H RKKY( g ap) = ft {Rj£f)SvS2+F S {R ^ £FKSlxS2)y 

+F 3 * (R, ep)^ + F» (R, e F )S\S z 2 . (3) 
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FIG. 2: (color online). The range function of RKKY interaction 
as function of the distance between localized spins R (Fig.2(a,c)) 
or the Fermi energy £f (Fig.2(b,d))- The inset shows the intrin- 
sic case (£f = 0). Fig. 2(a), (b) depict the RKKY interaction with 
massless Dirac electrons, and Fig. 2(c), (d) the RKKY interaction 
with massive electrons (A = 25 meV)[13]. Fig. 2(e) is the range 
functions of BR interaction, and Fig. 2(f) the absolute values of BR 
range functions with logarithmic coordinates. The blue (solid) lines 
are the range function F\(R,£f), the red (long dashed) lines are the 
F2(R.£f), the green (short dashed) ones are F}(R,Ef), and the cyan 
(dash dotted) ones are F4(R,£p). We choose £p = 100 meV for Fig. 
2(a,c), R = 30 nm for Fig. 2(b,d) and e F = - 18 meV for Fig. 2(e,f). 
The zero point of energy is at the midpoint of the energy gap caused 
by breaking TRS in Fig. 2(c)-(f). 



There are two dominant differences between the RKKY inter- 
action for the gapped (Eq.(3)) and gapless (Eq.(l)) cases when 
the Fermi energy is located in the conduction band (Ef > A) 
(see Fig. 2(c,d)). The first is that the range function of the 
DM term can be negative for the gapped case. We can still im- 
plement the pure DM model by properly choosing a specific 
Fermi energy e c F and/or the spacing of neighboring spins. The 
second difference is that the gap opening induces an additional 
out-of -plane Ising term along the z direction with a relatively 
weak correlation between the local spins. This is because the 
gap opening effect looks like a perpendicular magnetic field 
leading to a Zeeman-like splitting Act,. 

When we tune the Fermi energy into the gap, the RKKY 
interaction can be a short-range interaction, i.e., the BR inter- 
action [17]. Figs 2(e) and 2(f) show that the BR interaction 



mediated by massive Dirac electrons also contains all the four 
terms. This is because the spin orientation on the surface of 
constant is not influenced by the gap opening away from the 
vicinity of Dirac point. However, the range functions are to- 
tally different. From Fig. 2(e) we can see the Heisenberg 
term is always antiferromagnetic, while the two Ising terms 
always give ferromagnetic correlation. Fig. 2(f) shows the 
exponentially spatial decay behavior of the BR interaction. 
The Heisenberg term Ff {R,£f) and Ising term Ff (R,£ F ) are 
dominant with almost the same amplitude under a crossing 
point of spacing R ~ 19 nm, which means one can realize the 
XZ model //ff ~ Ff (R,e F ) (S^ + S\S Z 2 ) on the lattice of 
the surface of IT. Above this crossing point DM term play the 
leading role, however, with rather small values. 

With increasing the Fermi energy, the warping effect of the 
energy dispersion of the surface states becomes more signif- 
icant, resulting in a hexagonal constant energy surface (see 
Fig. 1(c)). The warping effect behaves like a perpendicu- 
lar anisotropic effective magnetic field that breaks the rota- 
tional symmetry, which is different from the gap opening ef- 
fect. This anisotropy must lead to an anisotropic, i.e., a crys- 
tallographic orientation-dependent RKKY interaction. We 
consider two local spins arranged along different crystallo- 
graphic directions (see Table I). These formula indicate that 
the anisotropic effective magnetic field results in more com- 
plicated spin models. 

Spin configurations and anomalous Hall effect. — Now we 
turn to discuss the possible spin configurations of the ground 
states of the 2D spin systems in the square and triangulated lat- 
tices on the surface of 3D TI. The combination of the Heisen- 
berg interaction, DM interaction, and Ising interactions makes 
it a rich platform to study all kinds of spin configurations. 
First we consider a pure DM model which can be imple- 
mented by tuning the Fermi energy or the spacing of neigh- 
boring spins. The DM interaction twist the spin orientation of 
the neighboring spins and leads to a non-coplanar spin phase 
or chiral spin phase. For example, the DM interaction cant the 
spins out of the plane and form an umbrella-like spin structure 
with a net ferromagnetic moment (see Fig. 3). When chiral 
electrons hop on the non-coplanar spin sites, the anomalous 
Hall effect can be realized since they obtain complex phase 
factor (Berry phase) which works as an internal magnetic field 
if it is not canceled. Thus the presence of spin chirality and 
net ferromagnetic moment can yield an anomalous Hall effect 
on the surface of the 3D TI [18, 19]. In a square spin lattice, 
the pure DM interaction can lead to a perpendicular nearest 
neighbor spin ordering. Together with the Heisenberg inter- 
action, the spin ordering can be non-coplanar in the square 
lattice shown in Fig. 3 (a) . For a triangulated spin lattice, 
the DM term and ferromagnetic Ising terms can induce spin 
frustration and have spins to point out of the plane to form a 
chiral spin state, illustrated in Fig. 3 (b). If we define the spin 
chirality Si • (S2 X S3) to describe the ferromagnetic moment 
for each triangle, the anomalous Hall effect can happen since 
the Berry phase is proportional to the spin chirality and may 
not be canceled [19]. In the Kagome lattice antiferromagnet, 
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TABLE I: The crystallographic orientation-dependent RKKY interaction caused by the warping effect. The range functions depend on the 
angle 6 which is defined in the direction respect to the [110] crystallographic direction, and are different from the range functions without 
warping effect. 
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thermodynamic and neutron scattering measurements have re- 
vealed the chiral spin configuration and net ferromagnetism 
induced by the DM interaction [20] . The anomalous Hall ef- 
fect can be measured by the transverse Hall conductivity on 
the surface of 3D TI. 




(a) (b) 



justing Fermi energy, such as DM model, XXZ model and 
XZ model. These realizations would not be destroyed by the 
gap opening caused by the breaking TRS and the warping ef- 
fect. The surface magnetism of 3D TIs provide us a model 
platform to study spin configurations and dynamics of various 
spin models, and pave the way for explore new fundamental 
physics and new type spintronic devices. 
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FIG. 3: (color online). Schematic chiral spin configurations of spin 
systems in the square and triangular lattices with the DM interaction 
and Heisenberg interaction. 

When the antiferromagnetic Heisenberg interaction domi- 
nates, the spin configuration is generally collinear or copla- 
nar, which has no spin chirality. The anomalous Hall effect is 
not expected. The square spin lattice has long-range collinear 
antiferromagnetic ground state. For a triangulated spin lat- 
tice, the long-range coplanar state may develop, like the well 
known 120° long range order. Since the existence of spin 
frustration, the ground state of triangulated spin lattices can 
be highly degenerate and show no long range order. The in- 
troduction of DM interaction and ferromagnetic Ising inter- 
actions will remove the degeneracy partly or completely. By 
finely changing the parameters, the spin system can even tran- 
sit into a spin-glass phase. This means one can construct an 
artificial spin frustration system utilizing STM technique on 
the surface of the 3D TI. 

Neutron scattering will be a useful tool to detect the sur- 
face and bulk spin structure of 3D TI. To enhance the neutron 
scattering signal from the surface magnetism, it is useful to 
use large angle neutron scattering technique and pile up many 
layers of 3D TI with parallel surface. 

In summary, we propose a new scheme to manipulate the 
carrier mediated spin-spin interaction on the surface of the 
3D TI electrically, i.e., RKKY interaction and BR interaction. 
The helical surface state leads to the twisted DM interaction 
and an in-plane Ising interaction. The gap opening and warp- 
ing effects introduce isotropic and anisotropic Ising-like terms 
at low and high Fermi energies, respectively. This spin-spin 
interaction can be used to realize different spin models by ad- 
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